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Abstract 

We obtain some new results concerning the small deviation prob- 
lem for S = q"'Xn and M = sup„ q^Xn, where < g < 1 and 
are i.i.d. non-negative random variables. In particular, the asymp- 
totics is shown to be the same for S and M in some cases. 
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1 Introduction 

Let us consider the following series 

oo 

S = J2^nXn, (1) 

n=0 
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where is a sequence of positive numbers with (T„ ^ and X, Xq, Xi, . . . 
are a.s. non-negative, i.i.d. random variables. By Kolmogorov's Three Series 
Theorem, 5* < cxo a.s. if and only if 

oo 

^Emin(l,a„X) < oo. (2) 

n=0 

Under this condition, we study the small deviation problem, also called small 
ball problem, or lower tail probability problem for S: 

¥{S <e), ase^O. (3) 

There has been a lot of interest in small deviation problems in recent years 
(cf. the surveys by Lifshits (1999) and Li and Shao (2001)). The question of 
small deviations of sums was first addressed by Sytaya (1974), Dudley et al. 
(1979), and Li (1991) for Gaussian random variables. Later, this was general- 
ized by Lifshits (1997) (see also references therein), Dunker et al. (1998), and 
Rozovsky (2007) for random variables X with finite variance. Then Aurzada 
(2006), Aurzada (2007), and, most recently, Borovkov and Ruzankin (2008a) 
and Borovkov and Ruzankin (2008b), give general treatments only under the 
necessary and sufficient condition ([2]). 

The case of polynomial decrease of (cr„) seems to be almost completely 
understood by now thanks to Borovkov and Ruzankin (2008a). The latter 
paper shows that there are different regimes in the sense that if (o"n) de- 
creases slowly enough (in relation to the lower tail of X) then that order of 
decrease determines the lower tail of S. If, on the other hand, (cr„) decreases 
sufficiently fast then the lower tail of X determines the lower tail of S. 

In this note, we study the case of exponential decrease of (cr„), which is 
considered by Dunker et al. (1998) under the assumption EX^ < oo and 
X absolutely continuous, and with similar conditions to ours by Borovkov 
and Ruzankin (2008b). Here we continue the theme from Aurzada (2007), 
Borovkov and Ruzankin (2008a), and Borovkov and Ruzankin (2008b) and 
investigate ([3]) under minimal assumptions. This must necessarily yield less 
precise assertions. In particular, we confine ourselves to the logarithmic order 
of the small deviations. Contrary to this, the early works for this problem 
mentioned above focussed on solving for particular distributions or under 
restrictive assumptions, such as finite variance, which could then yield very 
precise results such as the strong asymptotic order of ([3]). 
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We are going to use the following notation for strong and weak asymp- 
totics: We write / < if limsup//^' < 1. Analogously, f ^ g is de- 
fined. Furthermore, f ^ g means \imf/g = 1. We also use / ~ (7 if 
< liminf f /g < limsup f /g < 00. 

As already mentioned, we consider the special case that cr„ ~ with 
some < g < 1. In order to get the logarithmic order of ([3]) it is, in 
most cases, sufficient to treat o"„ = g". We come back to this question in 
Remark UM I.e. we consider 

00 

5 = J]g"X„. (4) 

n=0 

In view of ([2]), we need to assume that the necessary and sufficient condition 
for the problem to be well-posed, 

Elogmax(X, 1) < 00, (5) 

holds, which we do in the following. This is the only condition imposed on 
the upper tail of X in this paper. Note that this condition does not depend 
on q, i.e. on the sequence unlike in the polynomial case, cf. Aurzada 

(2006), Aurzada (2007), or Borovkov and Ruzankin (2008a). 

The main argument in this note (presented in Section [2]) allows to cal- 
culate the logarithmic small deviation order and constant for S from (jl]) for 
basically all commonly considered distributions. Furthermore, this can be 
extended to determine the small deviation order of the supremum M given 
by M = sup„ q"'Xn, which surprisingly leads to the same rate in many cases. 

Apart from presenting the new results related to the small deviations of 
S and M with exponentially decreasing weights, this note has the purpose of 
giving a simple illustration of the general treatment of the small deviations 
of S from ([T]). Namely, to the knowledge of the author this case is the easiest 
example that shows how the problem is tackled, in particular, how fruitful 
the use of Tauberian theorems is in this context. 

The paper is organized as follows. In Section [21 we present the strikingly 
simple main argument that helps us to solve the small deviation problem for 
S from (jlj) . In Section [3], several examples are given under various conditions 
for the lower tail of X. We continue in Section H] with a comparison to 
the small deviations of the supremum M. Section O provides the necessary 
Tauberian- type arguments and a final comment. 
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2 Main argument 



The main argument is very simple. Recall that considering small deviations 
is equivalent to considering Laplace transforms at infinity, by the use of 
Tauberianian-type theorems, cf. Bingham et al. (1989) and Lemma [13] below. 
Let us define 

F(A) := -logEe"^^ and G{X) := -logEe"^^. 

The goal is to deduce the behaviour of F from the behaviour of G. 
Note that in this particular case, (jl]) yields 

qS + X = S. (6) 

This implies, by the independence of the X^s, F{qX) + G{X) = F{X). We 
iterate this and obtain that, for all > 0, 

F{X) = G(A) + G{qX) + ... + G(g^A) + 

Note that, when A > 1, one can choose N = N{X) such that g^'^^A < 1 < 
q^X. Then < < F(l). We summarise: 

Lemma 1. For any A > 1, 

^ G(g"A) < F(A) < F(l) + ^(^"^)- (7) 

0<n<J2S>L. 0<n<fiHa4- 

— — logl/g — — logl/ij 

Note that F{1) is independent of A. Thus, one can determine the asymp- 
totics of F at infinity completely from the behaviour of G(A) for A > 1. We 
are going to apply this lemma in several examples. 

For concrete distributions, G can be calculated explicitly; and Lemma [T] 
turns the small deviation problem into an easy calculation exercise. If only 
the asymptotics of the lower tail of the distribution of X is given, one can 
obtain the behaviour of G at infinity, and thus the one of F via ([7]). 

Recall from Aurzada (2007) that in the case of polynomially decreasing 
sequences (cr„) in ([T]), it is possible to treat the small deviation problem for 
S analogously to the small deviation problem for M = sup^ cr„X„. Note that 
this is not possible with the current approach, since the technique relies on 
([6]). However, we come to the supremum case in Section HI 

We finally point out that Lemma [1] does not require any other condition 
apart from the necessary and sufficient condition for the problem to make 
sense, (jS]), which ensures the finiteness of all expressions. 
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3 Applications 



3.1 Random variables with positive mass at the origin 

We start with the case when X has a positive mass at the origin. This 
corresponds to G tending to a constant. 

Theorem 2. Let P (X = 0) = po > 0. Then 

-logP(5<£) ~ ij^^^ logl/e, ase^Q. (8) 
log l/q 

Proof: If X has positive mass at zero G{X) ~ — logpo- Note that in partic- 
ular, G{X) < — logpo for all A. This together with ([7]) shows that 



0<n<-JH£4- 0<n<T^2£4_ 

— — logl/g — — logl/ij 

/logA \ log 1/po 

The proof of the lower bound is as follows. First, let us define G by 
G{\) =: — logpo + G(A). Note that G is non-positive and increasing and 
that G{\) 0. Therefore, 



— —log l/q — —logl/g 



^ log A 
0<n<-i — \t- 

— — logl/g 



„+i x(l - g) j^i^^ x(l - g) y{\ - g) 



Now I'Hospital's Rule shows that the last term divided by log A tends to zero, 
since G{X) 0. This yields that F(A) > (log A) log(l/po)/fog(l/g)- Thus, 
we finally obtain that F{X) ~ (logA) log(l/po)/fog(l/?), and the assertion 
follows from Lemma [T3l □ 

Example 3. As an illustrative example consider Bernoulli random variables 
given by P (X = 0) = P (X = 1) = 1/2 = po and g = 1/2. In this case, S is 
uniformly distributed in [0, 1] and equality holds for all < £ < 1 in (jH]). 

However, if we take for X a distribution that has sufficiently heavy tails 
and a mass at zero, none of the results in the literature applies. 
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3.2 Random variables with regularly varying lower tail 



Now, we continue with the result under the assumption that the distribution 
function of X behaves essentially as a polynomial for small values. This 
corresponds to the case of logarithmic increase of G. 

Theorem 4. Let P (X < e) ^ , as £ — > 0, for some /3 > 0. Then 

-logP(S<e)~^i!2ii^. ase^,. (9) 
2 log l/q 



Proof: The assumption for the lower tail of X implies that Ee~^"^ ~ A^^, as 
\ ^ oo. The monotonicity of G implies that there are constants Ci, C2 G M 
such that 

/?logA + Ci< G{\) < /?logA + C2, for all A > 1. 
From ([7]) we deduce that 

F(A)<F(1)+ (/51og(?"A)+C2). 

After a short calculation one can see that the strong asymptotic order of the 
right hand side, when A — 00, is /5(logA)^/(21ogl/g). 

Analogous arguments show the lower bound. I.e. we obtain 

F[X) ~ — ; , as A — s> 00. 

^ ' 21ogl/g' 

Finally we use Lemma [131 D 

This theorem is proved by Borovkov and Ruzankin (2008b); however, the 
present method uses a significantly simpler proof. Also, a stronger version 
of this theorem was proved by Borovkov and Ruzankin (2008b) for rational 
(3 and with a stronger assumption for the lower tail of X. 

Remark 5. With essentially the same proof, one can show even more. 
Namely, assume that P (X < e) ^ £f^£{l/e), as e — 0, where /3 > and 
£ is a slowly varying function at infinity that is bounded away from and 00 
on every compact subset of [l,cxo[. Then (Q holds. In particular, i has no 
infiuence on the order, cf. Borovkov and Ruzankin (2008b). 
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Example 6. As main examples one can consider X = \X'\p for Gaussian ran- 
dom variables X' or symmetric stable random variables X' (in both of which 
cases (3 = One can as well consider X with a Gamma distribution, 

Weibull distribution, etc. 

Recall that Dunker et al. (1998) consider the most important case X' 
standard normal and p = 2 and give much more precise estimates. However, 
for random variables with a heavy tail (e.g. the mentioned stables) the above 
result seems to be new. 

Remark 7. Using essentially the same technique as in the proof of TheoremU] 
one also tackles the case when — log P {X < e) is some other slowly varying 
function. For example, in the case that X is log normal one obtains in this 
way that -logP(5 < e) ~ (log l/£)7(6 log 1/g), as e 0. 

3.3 Random variables with exponentially small lower 
tail 

Finally, we consider the case that X has exponentially little mass near the 
origin. This corresponds to the case of polynomial increase of G. 

Theorem 8. Let — logP(X < £:) ~ Ke~^ , as e 0, for some 7 > and 
K >0. Then 

-logP(5<£)~- ^-TTT^e"^, ase^O. (10) 

o \ — / n _ ^7/(1+7) U+7 ' ^ ^ 



Proof: From the assumption we deduce, by Bingham et al. (1989), The- 
orem 4.12.9, that G(A) ~ K'X'^', as A ^ 00, where K = {K'^' {1 - 
y)i-7')i/(i-7') and 7 = 77(1 - 7'). 

From ([7]) we deduce in a similar fashion as in the proof of Theorem H] that 

F(\) ~ 7, as A — s> 00. 

^ ^ 1 _ g7" 

Again by Bingham et al. (1989), Theorem 4.12.9, we conclude the proof. □ 

A similar result holds if we add a slowly varying term in the asymptotics 
of the lower tail of X. Furthermore, one can prove an analogous result under 
the assumption that — logP {X < e) ^ e'^ . 

Under only slightly stronger assumptions Borovkov and Ruzankin (2008a) 
obtained the same result. 
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Example 9. An example that fits perfectly into the situation of Theorem [H] 
is the inverse Weibull distribution, that has exponentially little mass near 
the origin and a heavy tail. 

As another illustrative example consider a stable totally skewed random 
variable X', i.e. a positive random variable with Laplace transform Ke~^^ = 
exp(— i^A"), with > and < a < 1, cf. Samorodnitsky and Taqqu 
(1994). These random variables are a-stable and have exponentially little 
mass near the origin. Theorem [8] can be applied to X = X'^, where 7 = 
a/{p{l — a)). Note that in the case p = 1 the sum S is also a stable random 
variable, which makes it easy to verify the constant occuring in (fTOj) . 

4 Comparison with the supremum case 

In this section, we give an extension and comparison to the small deviations 
of the supremum. Namely, we consider the small deviation problem for 

M := sup anXn, 

n 

when an = q"". Surprisingly, we obtain the same small deviation rate for M 
and S in the setup considered in Section [31 This contrasts the results for the 
cases when (cxn) is polynomially decreasing, where the small deviation rates 
for M and S are always distinct, cf. Aurzada (2007). 

Let us start with the case when X has a positive mass at the origin 
considered in Theorem [21 The resulting small deviation rate and constant 
are the same for S and M. 

Theorem 10. Lei P (X = 0) = po > 0. Then 

- logP (M < e) ~ - logP (5 < e) ~ l^^ilZ^ log as e 0. 

logl/g 

Proof: Since M < S", we only have to show an upper bound for P (M < e). 
Let r > 1. Since the distribution function P(X < 5) is cadlag, there is a 

5 > such that P (X < 5) < rpo- 

Let e < 5 and choose the maximal X G N such that eq^^ < 6, i.e. 
asymptotically, when e — 0, X ~ log((5/£:)/log(l/g) ~ log(l/£:)/ log(l/g). 
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Then, by the independence of the X„'s, 

N N 

logP(M<£) < J]logP(X < eg-") <^logP(X<5) 

n=0 n=0 

N 

< '^^ogrpo = (A^ + 1) logrpo- 

n=0 

If we let e tend to zero, we obtain 

logP(M<e) 
limsup - — — 7—^ < logrpo, 
e^o log(l/e)/log(l/g) 

for all r > 1. We let r ^ 1 to finish the proof. □ 

We continue with the case considered in Theorem HI Here again we find 
that M and S have the same small deviation rate and constant. 

Theorem 11. Let ¥ {X < e) ^ , as e ^ for some /5 > 0. Then 

-logP(M<£) ^ -logP(^<£) ~ /^(^QSV^)' ^ ase^O. 

2 log l/q 



Proof: In view of the trivial fact that M < S*, we only have to show an 
upper bound for P (M < e). Note that 

oo N 

logP (M <e) = ^logP (g"X < < ^ logP (X < eq''') , 

n=0 n=0 

for any X > 0. We choose the largest X G N such that eq~^ < 1, i.e., as 
£ — >• 0, iV ~ log(l/e)/log(l/g). Then, by assumption, the last term is less 
than 

N N 

\og{ceq-'^Y = (3{- log l/e + log c) (X + 1) + J] (3n log l/q, 

n=0 n=0 

for some constant c > depending only on the lower tail of X. A short 
calculation shows that the asymptotic order of this term, as £ ^ 0, is indeed 
— /3(log l/£:)^/(2 log 1/g), as asserted. □ 
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We finish with the case considered in Theorem [HI where X has exponen- 
tially little mass near the origin. Here, the small deviation rates for S and 
M are the same, however, the small deviation constants differ (compare the 
constants in ffTOl) and ffTTl)'). 



Theorem 12. Let — logP(X < e) ~ Ke as e ^ 0, for some 7 > and 
K >0. Then 

K 

-logP(M<e)~^ — ase^Q. (11) 

Proof: Let r g]0, 1[. By assumption, there is a < 5 = 5(r) < 1 such that 
for all e < 5, 

(1 - T)Ke-^' < - log P (X < £) < (1 + T)Ke-''. (12) 

Let e < 5. We choose the maximal Xi G N such that eq^^^ < 6 and the 
maximal N2 such that eg"^^ < 1. Note that 

Ni 

- logP (M < e) = ^ - logP (g"X < e) 

n=0 

N2 00 

+ -logP(g"X < £) + J2 -logP(g"X < e). (13) 

n=Afi+l n=N2+l 

Let us look at the first term in (fT3|) . Using (fT2|) we estimate it from above 
by 

- logP (X < q~-e) < (1 + T)ire-^ (g^)" ~ 

n=0 0<n<{24Z£ ^ 

— — logl/q 

as £ — > 0. Analogously, the respective lower bound (with (1 — r)) follows. 
Let us look at the second term in flTSl) . We use the assumption to estimate 

^ ^ 0(^1+2)7 _ 0(^2+1)7 
J2 -logP(X<g-"£) < J2 Ce-^q-^ = Ce-^'i ^— , 

which holds for some constant C > only depending on the lower tail of X. 
By the choice of Ni and N21 the last term can be estimated from above by 

(el5Va^ - e^a^ 6'^ - 1 
^^-T, {^/o) q ^ ^ _^ i ^ 

1-q'y l-q'r 
10 



Finally we come to the third term in fll3l) . Note that 

-logP(g"X < e) ^ ^ P(g"X > e) / dx, 

where we used that log x ~ a; — 1 for x — > 1 and P (X < 1) > 0. When e ^ 0, 
the last term is of order 



r dr /"^ dr /"^ dr 

/ F{xX>e)^= E Il^^>,/.j ^ = E / ]l{^>,/„^ 
Jo Jo Jo 



This equals Elogmax(X, 1), which is the finite constant from ([5]). 
Therefore, putting the three estimates together, 

(1 + t)K 
-\og¥{M<s)< \[_^^ e-\ 

as £ — > 0, for all r > 0. Letting r — > gives the upper bound. The lower 
bound is established in exactly the same way. □ 



5 Tauberian theorem and final comments 

Let us finally provide the mentioned Tauberian-type arguments. The proof 
is along the same lines of the proof of Theorem 4.12.9 in Bingham et al. 
(1989). We refer e.g. to Borovkov and Ruzankin (2008a), Lemma 6.1, and 
the reference mentioned there. 

Lemma 13. Let S be any non-negative random variable and let j > 1 and 
K >0. Then 

- log Ee"^^ ~ K{\og Xy, as X^oo, (14) 
holds if and only if 

-\ogF{S <e) K{\ogl/e)\ ase^O. (15) 

Remark 14. Finally, let us comment on whether (T„ ~ g" can be replaced 
by cr„ = g". Several authors have investigated this question, cf. Li (1992), 
Gao et al. (2003), Gao and Li (2006), Aurzada (2006), or Aurzada (2007). In 
fact, using the technique from the proof of Lemma 4.1 in Aurzada (2007) it is 
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easy to see that in the situation of Theorems [21 IH [101 and [H] the assumption 
cr„, = g" can be replaced w.Lo.g. by (j„ = g". 

Contrary to this, for Theorems [8] and [12] it is not sufficient to assume 
o"n ~ g" as one can see easily from the stable sum in Example [9] or the proof 
of Theorem [T2l Nevertheless, here the proof of Theorem [12] also serves in the 
general case. In the case of the sum however it is not clear how to determine 
the correct constant. 
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